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Section 1: Numbers and sequences. 



Objectives 

(1) A real number is a limit of a sequence of finite decimal expressions. 

(2) Two real numbers that are not equal differ by some positive distance 
and so must have different decimal expansions. 

(3) The modulus \ ■ \ allows arguments about the distance between numbers 
to be written precisely. 

(4) The modulus and quantifiers allow us to precisely define what it means 
for a sequence of numbers to converge. 

(5) An increasing bounded sequence converges. 



Analysis deals with the real numbers. In order to understand what they are, we 
start off by considering the following example. Let f{x) = — 2. Then the graph 
of / for X between and 2 looks like it crosses the y = axis (Draw the graph). 
On the other hand, we know that-\/2 is irrational, so if we do all our calculations 
over the rational numbers Q (which we - and computers - often do in practice), 
then the graph somehow leaps from the negative y side of the to the positive 

y side of the x-axis without ever crossing it (becausey^ is irrational). 

In order to do analysis, we need to be able to work with all the real numbers, 
not just the rationals. The positive square root of 2 is an example of a real number: 

V2 = 1.414213562... (1) 

The problem is - what does that mean? And how could we use the infinite decimal 
expansion to prove results like (1.414213562...)^ = 2.000...? 

Definition 1.1. The real numbers are the numbers that may be written using 
infinite decimal expansions. Different expansions are allowed to represent the same 
real number (for example, 1.099999 . . . and 1.1 are the same real number). 

It is very important to understand that the representation of a given real 
number as an infinite decimal is sometimes not unique. Think of the infinite 
decimals as a language for talking about the real numbers which has the small 
difficulty that some "words" (real numbers) can be correctly translated in two 
different ways. 

Let's prove that 1.1 and 1.0999... are different decimal representation for the 
same real number. Try to follow the two proofs very carefully: the first is a little 
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complicated but only uses simple properties of finite decimals (that is, rational 
numbers), and manipulation of quantifiers and inequalities. This is a GOOD 
proof in that all of it can be described using things we understand well. 
GOOD proof that 1.1000... = 1.09999... Assume the two decimal expansions 
represent different real numbers. Then either 

1.1000... > 1.09999... 

or 

1.1000... < 1.09999... 

Let's assume the first case (the second leads to a similar contradiction). If 

1.1000... > 1.09999... 

then 

1.1000...- 1.09999... = e>0 

for some strictly positive e. 

Now consider the number T = 1.099... 9 in which there are exactly n digits 
after the point. Since 

1.0999... - T = 0.0... 0999... > 

we have that 1.0999... > T so 

1.1000... - T > 1.1000... - 1.09999... = e. 

On the other hand, 1.1000... — T is a difference of two finite decimals so we may 
compute it easily: 

1.1 - r = 0.0... 01 = lO""" 

(the 1 is in the 77.th place). Now let us choose n with the property that 10"" < ^^e. 
But this is impossible because the difference is supposed to be larger than e. 

This contradiction proves that 1.1000... > 1.09999... is impossible, so we 
deduce that 1.1000... < 1.09999.... 

A similar proof shows that 1.1000... < 1.09999... is impossible, and we are 
done. □ 

For the second "proof" , we will make some fairly vague assumptions about 
infinite decimals and how they can be manipulated. This is a BAD proof because 
it assumes we can treat infinite decimals in a certain way, when the whole point 
of the argument is to show that infinite decimals behave in a rather strange way. 
Follow this proof carefully and try to work out where we are doing something that 
cannot be justified using simple well-understood properties of finite decimals and 
inequalities. 



3 



BAD proof that 1.1000... = 1.09999... Let S = 1.0999.... Then^ lOS- = 10.999..., 
so^ lOS - S = 9S = 10.999... - 1.0999... = 9.9, so dividing^ by 9 we see that 
5 = 1.1. □ 

The moral is this: if we want to build up an understanding of real num- 
bers (and hence analysis) from our sound basis of the rationals, finite decimals, 
inequalities, algebra and so on, then we must be prepared to use careful proofs by 
contradiction involving the existential quantifiers 3 and V. 

Now we have a better understanding of the non-uniqueness problem, let us 
make a formal interpretation of (1). Imagine the real numbers are points on a 
number line: 



-10 12 3 

The real number -\/2 is the point indicated with an (infinitely thin) arrow. The 
equation (1) means that a certain infinite decimal represents the same point, but we 
cannot manipulate the infinite decimal - all we can manipulate are finite decimals. 
So what is the exact connection between the finite decimals 

1,1.4,1.41,1.414,... (2) 

andy2? 

Definition 1.2. A list of numbers ai, a2, as, ■ • ■ is called a sequence. 

Sequence are sometimes written (an) or {an}- 

So (1) says that\/2 is represented by a sequence of finite decimals. However 
some sequence clearly do not represent real numbers: 1,2,3,4,... for example. 
The sequence (2) is not just an arbitrary sequence - it is a sequence getting closer 
and closer to some real number. For technical reasons, it is useful to restrict 
attention to increasing sequences (for example, if a„ is the nth decimal expansion 
of a number then (a^) is an increasing sequence). 

Definition 1.3. A sequence (on) is increasing if < Qn+i for every n > 1. A 
sequence (a„) is bounded above if there is some number R with < R for all 
n>l. 

Notice how we may use quantifiers to write these definitions: 
(a„) is increasing if a„ < a^+i V n > 1; 

very dubious step: I am claiming that if the billionth digit of some decimal expansion 
of is a 9 then there is a decimal expansion of IQS whose billionth digit is also a 9. If pressed I 
could prove this, but the proof would begin: assume not; then every decimal expansion of S has 
the property that the billionth digit is not a 9... and we'd end up with an even more complicated 
argument than the GOOD proof. 

^More problems: how on earth do we perform an infinitely long subtraction problem? 

■^This step is now back in the world of finite decimals and so is okay. 
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(on) is bounded above if 3 i? such that < -R V n > 1. 

How can we express the fact that the sequence (1) is getting closer and closer 
to-\/2? Our statement must involve potentially ALL the terms of the sequence: 
1 is within distance 1 of\/2 since they have the same integer part. 
1.4 is within distance 0.1 of a/2 since they have the same integer part and first one 
decimal digit. 

1.41 is within distance 0.01 of\/2 since they have the same integer part and the 
same first two decimal digits. 

1.414 is within distance 0.001 of-\/2 since they have the same integer part and the 
same first three decimal digits, 
and so on ad inGnitum. 

The reason why the sequence of decimals (1) is converging to a/2 is not just 
that the terms get closer and closer to ^/2: they get arbitrarily close. That is, 
given any positive number at all (e > 0) the terms of the sequence are eventually 
(so long as we include at least = -^(c) terms) distance less than that positive 
number from-\/2. 

Recall that is the absolute value of x; | — 3| = 3 and so on. It follows that 
|a; — y| is the distance between x and y. Thus, numbers x and y are close together 
if \x — y\ (which is > 0) is small. The basic property of | | that we need is the 
triangle inequality: 

\x + y\ < \x\ + \y\. (A) 

We proved this in lectures - make sure you see why it is true as we will use it 
often. A useful corollary of A (prove this) is the following: 

Ix + 1/1 > — \y\. (^') 

Definition 1.4. A sequence (a„) converges to the real number A if, given any 
e > there exists N such that n > N implies that |A — < e. The number A is 
called the limit of the sequence, and we write 

A = lim ttn 

n— >-oo 

or 

an — > A. 



Example 1.5. This examples shows how to use Definition 1.4 in practice. 
Problem: Prove that the sequence defined by = 1 + converges. 
Solution: An educated guess is that will converge to 1. According to Definition 
1.4, we must show that |a„ — 1| can be made arbitrarily small by choosing n large 
enough. 

First do a little side calculation: 
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SO if I want to ensure that |a„ — 1| < e, I need to be sure that n> — 2)' 

We are now ready to do the proof: 
Given any e > 0, define iV = - 2) +1. Then, for any n > N, we have 



lOr,, - 1| 
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proving that a„ ^ 1 as n ^ oo. 

We have seen that the specific real number -\/2 is the limit of a specific in- 
creasing sequence of decimal approximations. More generally we have the following 
general result: 

Theorem 1.6. If {an) is an increasing sequence bounded above, then it converges: 
there is a A e M such that an — > A. 

This theorem may be thought of as telling us what the real numbers look like 
- anything you can make appear as the limit of an increasing bounded sequence 
is a real number. The method of proof is to simply start producing the decimal 
digits of the limit. 

It also will allow us to exhibit subtle phenomena: for example, does the 
sequence 1,1 + ^ — ln2,l-|-i + | — ln3,... converge? If so, to what? 

Proof. First decide what the integer part of the limit should be: 



Let X be the largest integer with the property that eventually (for all n 
larger than some number A'^o), all the terms of the sequence are larger 
than or equal to x and smaller than x + 1. 

R (upper bound) 



al a2 a3 ^ a4... 

















Here x = 2. 



We now know that 



n> No 



\x — a-n] < 1. 



Next, simply enlarge the previous diagram by a factor of ten and decide what the 
first decimal digit should be: 



Let xi be the largest digit (a whole number between and 9) with the 
property that eventually (for all n larger than some number iVi), all the 
terms of the sequence are larger than or equal to x.xi and smaller than 
x.xi + 0.1. 



R (upper bound) 



2.0 



2.1 



2.2 2.3 



2.4 



2.5 



2.6 



Here xi = 4. 



We now know that 

n > Ni =^ \x.xi — ttnl < 0.1. 

And so on: enlarge by a factor of ten again and decide what the second decimal 
digit should be: 

Let X2 be the largest digit (a whole number between and 9) with the 
property that eventually (for all n larger than some number N2), all the 
terms a„ of the sequence are larger than or equal to X.X1X2 and smaller 
than X.X1X2 + 0.01. 

N2 

R (upper bound) 
2.40 2.41 2.42 2.43 2.44 2.45 2.46 

Here X2 = S. 
We now know that 

n > N2 \x.x1X2 — an\ < 0.01. 

Continuing, we produce the real number 

A = X.X1X2X2X4 . . . , 

and numbers Nq, Ni, N2, . . . with the property that 

n>Nk ^ |an - A| < lO-^'^-^). 

Given any e > 0, choosing k large enough to ensure that lO"*^'^"^^ < e produces 
Nj. with the property that 

n > Nk =^ \an — A| < e. 

Thus the sequence converges and the limit is the real number A. □ 

Remark 1.7. Notice that if x and y are real numbers, then either x = y or there 
exists some e > such that \x — y\ > e. 

Or, as Euler put it: 

// a nonnegative quantity was so small that it is smaller than any given one, 
then it certainly could not be anything but zero. To those who ask what the 
infinitely small quantity in mathematics is, we answer that it is actually 
zero. Hence there are not so many mysteries hidden in this concept as 
there are usually believed to be. These supposed mysteries have rendered the 
calculus of the infinitely small quite suspect to many people. Those doubts 
that remain we shall thoroughly remove in the following pages, where we 
shall explain this calculus. 

Leonhard Euler (1707 - 1783) 
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A slightly more difficult idea is the following: by negating the quantified 
statement of convergence, we can prove that some sequences do not converge. 
It is useful to record first a "reverse" triangle inequality: we know that 

\x + y\ < \x\ + \y\ 

for all real numbers x and y. A little thought shows that 

|a; + yl > \x\ — \y\ 

for all real numbers x and y. 

Before the next example, let us recall how to negate quantified statements. 
Here is a quantified statement: in each year at UEA (first, second, third) there is 
a student all of whose relatives are tall. More formally: 

in each year group at UEA there is a student all of whose re l ations are talL (|) 

V i€{l 2 3} ^ ^ student s in year j \/ r, r a relation of s, r is tall 

That is: 

Vj e {1,2,3} 3 s e year j such that ^ r, r a relation of s, r is tall. 

Notice that the last statement is an implication: 

V J e {1, 2, 3} 3 s e year j such that \/ r, r related to s =^ r is tall, (J) 

where the last "for all" is taken over all people. We will negate the statement (J). 
Firstly, the statement says 

Vie{l,2,3},P(j) 

where 

P{j) = (3 s e year j such that W r, r related to s =^ r is tall.) 
So^ the negation is 

3je{l,2,3},not P{j). 
We now turn to the statement "not P{j)" ■ Since P{j) begins 

3 s e year j such that Q{s) 

the negation is 

V s e year j, not Q{s). 



^Notice that the negation of a theorem of the form for all a G A, Q{a) holds is a 
counterexample: there exists a £ A such that Q{a) does not hold. 
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So the negation of ($) may be written: 

3 j e {1, 2, 3}, such that V s e year j, not Q{s), 

where 

Q{s) = (V r, r related to s =^ r is tall,) 

Now Q{s) says that for all r a certain property (r being related to s) implies that 
r is tall. The negation is therefore a counterexample: an r which satisfies the 
property but is not tall: 

not Q{s) = (3 r, r related to s, such that r is short.) 

Putting it all together, we have the negation of (J): 

3 J e {1, 2, 3}, such that V s e year j 3 r, r related to s, s.t. r is short. (jj) 

That is, there is a year in which every student has a relative who is short. It may 
help to compare (jj) with (J): 

V J e {1, 2, 3} 3 s e year j such that y r, r related to s r is tall, (J) 

to convince yourself that negation is not difficult! 

Example 1.8. Write down a precise definition of the statement "(an) does not 
converge". Using this, prove that = (— 1)"" does not converge. 
Solution: Recall that the statement "(a„) converges to A" means: 

V e > 3 iV such that n> N =^ \an - A| < e. 

It follows that the statement "(an) converges" means: 

3 A, Ve>03A^ such that n> N =^ |an - A| < e. 
Negating this gives the statement "(an) does not converge": 

V A 3 e > such that V TV 3 n > iV with |an - A| > e. (3) 

Notice how this works: in particular, the negation of the statement n > N =^ 
|«n — A| < e is to say there is a counterexample: 3 n > N with | an — A| > e. 

To solve the problem we must therefore prove that the sequence an = (— 1)" 
has property (3). The idea is that if some a-n is very close to a number A, then 
some other term in the sequence cannot be. Let A be any number. Choose ^= \- 
Let N be any natural number. Notice that for each "V" we have simply chosen an 
arbitrary number, and for the "3" we have had to think a bit and choose a specific 
number. 
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Now, look at Oiv. If 

\aN - A| > i 
then (3) is true and we are done. If not, then 

\aN — A| < |, 

which means that 

aive(A-i,A+i). (4) 

Assume that (4) holds, and recall that \an+i — an\ = 2 for all n. By the "reverse" 
triangle inequality, 

\aN+i - A| = |(aAr+i - oat) + (oat - A) | > |aAr+i - oatI - |aAr - A| > 2 - ^ > i. 

So either is more than | from A or ajv+i is: we have proved property (3) and 
deduce that the sequence (a^) does not converge. 



Things you should have learned in this section 

(1) Any sequence (an) of finite decimals, with the property that the first 
n digits of a^,a^_|_i, . . . agree, converges to a unique real number. Any 
real number can be written (possibly in more than one way) as an infinite 
decimal expansion. 

(2) Exact definition of the statement "(an) converges to A". 

(3) How to prove using the definition that a given sequence converges. 

(4) How to prove using the definition that a given sequence does not con- 
verge. 

(5) If a sequence is bounded and increasing, then it is convergent. 
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Lecture summary sheet for Analysis section of MTHlAll. 
Section 2: Convergent sequences. 



Objectives 

(1) Proofs of convergence and divergence of sequences. 

(2) Algebra of convergent sequences. 

(3) How to use increasing + bounded to show that some sequences converge 
without knowing the limit. 



In this section we find how to manipulate convergent sequences and do some more 
examples. 

Examples 2.1. Consider the following four examples. 

(1) { j}^ the sequence = ^, i.e. 1, 

(2) {/n + 1 —y/n}, the sequence dn =\Jn + 1 —\fn^ i.e. -\/2 — l,-\/3 — \/2, • • • • 

(3) {1 + 1 + 1 + .. . + i-ln(n)}. 

We make the following observations: 

(1) the sequence {c^} gets closer and closer to zero. 

(2) we shall see that {d^) also approaches zero. 

Recall that a sequence (a^) conveiges to i if for any e > there is an N with 
the property that n> N implies |a„ — ^| < e. 

Notation 2.2. A sequence that does not converge to any I is said to diverge. For 
a convergent sequence, the number I is called the limit of the sequence. 

Example 2.3. The sequence {cn} = {^} converges to zero. In order to prove 
this statement, we must establish that Definition 1.4 holds for this sequence with 
£ = 0. Given any e > 0, choose N to be the smallest natural number with the 
property that N > K Then, if n > iV, we have |cn — 0| = ^<;^<e, which 
proves that {c^} is converging to zero. 

Example 2.4. The sequence {dn} — {/n+ 1 — \/n} converges to zero. This is not 
so obvious, and we should first convince ourselves that it is true - once we know 
why it is true we should be able to prove it. For this, we need a trick so useful 
that it has a name, "difference of two squares" : 

a'^ -b'^ = (a-b)ia + b), (■ - ■) 

which becomes (with a =\/n + 1 and h =\pn) 

1 = (Vn+ 1 -^/n) (Vn + 1 -^^/n) . 

This says that dn = ; which is clearly converging to zero sincey/n'+T -h/n 

is going off to infinity. Now we're ready for the proof. Given e > 0, choose N so 
that N>^. Then, if n > TV, \dn - 0\ =7^^ < 27^ < ^ < ^• 
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Theorem 2.5. If an ^ i and bn — >■ m, then 

(1) {an + bn) i + m (equivalently, lim (a„ + bn) = lini a„ + lim 6^ if both 

n— >-oo n— >-oo n— >-oo 

limits on the right exist). 

(2) anbn — >■ irn (equivalently, lim (a^5„) = lim x lim bn if both limits on the 

n— >-oo n— >-oo n— >-oo 

right exist). 

Discussion. Proof of (1): given e > 0, we know that there are numbers Ni and 
N2 with the property that 

n > Ni \an — -^l < cind n > N2 =^ \bn — m\ < 7:- 

So if TV = max{A^i, 7V2}, then 

n> N =^ \{an + bn) - {i + m) \ = |a„ - £ + 6„ - m\ 

< \an - ^\ + \bn - ml 
e e 

Thus an + bn ^ i + m. 

Proof of (2). In order to prove (2), we must show that the quantity \anbn — irn] is 
eventually small. By A, \anbn — ^Tn\ = \{an — t)bn + ^{bn — rn) \ < \bn\ ■ \an — ^| + 
\l\ ■ \bn — m\., which will be fine so long as we know that \bn\ is bounded. For this 
we need a 

Useful Lemma 2.6. // {bn} is a convergent sequence, then it is bounded: there 

is a number R such that \bn\ < -R for all n. 

Proof of Useful Lemma. We have bn — )■ m; take e = 1 in Definition 1.4. Then 
there is a number M such that n > M =^ \bn — m\ < 1. Now if \bn — m| < 1, 
then bn is within a distance 1 of m, so that < 1 + It follows that 

\bn\ < max{|6i|, I62I, • • ■ , I^'mI, 1 + \m\}, 
which proves the Lemma. □ 

Now we may continue with the proof of Theorem 2.5 part (2). By the Useful 
Lemma, we may find a number R with two properties: R > \bn\ for all n, and 
R > \£\. Now an ^ i and bn — >■ m, so given any e > we may choose Ni and N2 
such that 

n> Ni =^ \an -£\ < 7^ and n > N2 =^ \bn - m\ < 
Then if TV = max{7Vi, A^a}, 

n > N =^ Idn^n ~ -^^1 ^ \bn\ ' Wn — ^\ + K| " l^n ~ "f^l 

< \bn\— + — 

' "'2i? ' '2i2 
e e 

<- + - = €, 

2 2 

which proves that anbn — >■ □ 



A similar result holds for quotients of sequences, though we must avoid di- 
viding by zero. 
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Theorem 2.7. If an — >■ i, and {bn} is a sequence of non-zero terms converging 
to mj^O, then ^ ^ 



Discussion. This was proved in tlie lectures. Notice tliat a key element of the 
proof was a version of the Useful Lemma above, showing that the sequence 6„ is 
bounded away from zero: there is an r > such that r < for all n. (One way 
to prove this is to consider the sequence {^} - though to be sure this sequence is 
convergent you really need Theorem 2.7...) □ 

These two theorems allow more complicated limits to be found. 



hm an = - 

n— >-oo o 

^ — >■ 0, ^ — > and so on. Now 



Example 2.8. Let a„ = • Show that lim = -■ First notice that 



3+^ + ^ 



3 Un 



^ n + n2 + n3 

and the numerator and denominator are both convergent sequences (by Theorem 
2.5), so Theorem 2.7 applies: 

lilUn— >^cxD bn 3 

hm an = rr. = -. 

n^oo limn_j.oo Cn o 



Recall Theorem 1.6: a bounded increasing sequence converges. Similarly, a 
bounded below decreasing sequence converges. 

Example 2.9. Theorem 1.6 (and the non-increasing version) allow us to do some 
quite clever things. Here we use it to describe Euler's number, and to motivate 
some later material. Consider the function f{x) = log(a::) (natural logs of course). 
We know that for n > 1, / = J^~^^ ^dx = log(n + 1) — log(n). On the other hand, 
for X e [n, n+1], we have that ^ < - < - (Why?). It follows that ^ < / < - 

L ' 'J' n+1 — X — n ^ / n+1 n 

(Why? - see Lemma 3.16 below), so 



< log(n + 1) - log(n) < -. 
n + 1 n 



Consider the sequence 



11 1 , 

an = 1 + o + o ^ 

2 3 n 

Now 

dn+l - On = + ^ + ■ ■ ■ + ~ + ~ (^1 + ^ + ■ • • + ^ - logn 

= log(n) - log(n + 1) H < 

Til ~\~ 1 
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by the above calculation. It follows that the sequence {an} is decreasing. Also, 
each an is greater than or equal to zero (Why? Hint: show that a„ may be 
represented as the area between a staircase function lying above the graph of 
y = \ and the curve itself. This picture should convince you that o„ — ^ is clearly 
positive, which immediately shows that an is also). The picture below indicates 
why as — I > 0, from which we see that 05 > 0. 




area under curve = log 5 ^ 

It follows that {ttn} converges to some number 7: an — )■ 7- This number 7 (approx- 
imately 0.57721566. . .) is called Euler's number and it is somewhat mysterious: 
in particular, it is not known whether or not it is rational. 

Example 2.10. [This example was not covered in the lectures] The idea used 
above of estimating things by areas (which are in turn computed as definite inte- 
grals) gives some insight into the following difficult question: how big is 77.!? It is 
easy enough to check that n! grows faster than any power of n: for any k E N, 

k 

limn_).oo ^ = 0. (Prove this). What about n"? A convenient way to formulate 
this question is: if an = then does {an} converge to some number in (0, 00)? 
By drawing a graph, show that 

log 1 -h log 2 -I h log(n - 1) < ^ log{x)dx < log 2 -|- log 3 H h log(n). 

Evaluate the integral, and apply the function x ^ . Notice that (for example) 
giog2+iog3+ -+iog(n) = 2 • 3 • • - n = n! and so on. Deduce the inequality: 

, (n+l)"+i 
< n! < . 



gn-l 



Show that this implies that 

\/riT 1 
lim = -= 0.36788 . . . 

n— ^cxD n e 

What have we proved? The limit result shows that \/nl is approximately ^ (i.e. 
the ratio of the two quantities is close to 1) when n is large. This does not imply 
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(Why not?) that n! is approximately (f)"^ in the same sense. An estimate for 
77.! that has the property that the ratio the estimate for n! converges to 1 exists but is 
quite difficult to prove. Here's a common way of writing the result (called Stirling's 
formula): 



Things you should have learned in this section 

(1) How to decide if a sequence converges, and how to write down a proof. 

(2) How to use the algebra of convergent sequences to prove that more 
complicated sequences converge. 

(3) How to use various methods (algebraic tricks, representation as inte- 
grals) to prove that sequences converge. 

(4) All convergent sequences are bounded, and how to prove this. 
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Lecture summary sheet for Analysis section of MTHlAll. 

Section 3: Series. 



Objectives 

(1) An understanding of infinite sums and when they converge. 

(2) How to use our knowledge of sequences to prove things about series. 

(3) Test for convergence of series. 



A series is an infinite sum. We have aheady encountered and used series without 
noticing the fact. We used real numbers like\/2 = 1.4141.... This number is really 
an infinite sum: 

What does (*) really mean? Does it mean that any calculation involving -\/2 
involves infinitely many additions? Section 2 gives us a good idea of how to 
interpret (*): it means that we may approximate as well as we like by taking 
sufficiently many terms on the right of (*). This is just the observation that the 
decimal expansion of a real number out to n places is a close approximation to 
the number, how close depending on n. This idea is so often used that you don't 
notice it when you use it: every calculation you have done with tt for example, has 
really been done with some finite piece of the decimal expansion, 3.1415926 say. 
More generally, a series is going to be an expression of the form 



n=l 



ai + a2 + a3 + ... (S) 



(the Greek letter E represents a capital S for "sum"). By analogy with the prop- 
erties of real numbers discussed above, we shall say that the series (S) converges to 
£ if given any positive distance e > the finite sums of the form ai + 02 H — • + 0'n 
are within e of the fixed number £ for n big enough (how big depending on e). 

Provisional Definition 3.1. The series On converges to £, written sym- 

bolically Xl^i '^ri = £, if given any e > there is an M such that ii N > M then 

|En=l On - ^1 < e. 

Example 3.2. Let an = Then Yl'^=i = 1- To prove this, simply evaluate 

En=i On = | + iH \- ^ ^1- 2"^. It is clear that 2"^ ^- as iV ^- 00, so 

by applying Section 2 we see that On = 1- 

The argument used in the above example points the way to a more useful for- 
mulation of convergence for series. Given the series a-n, form the associated 

sequence of partial sums {sm}, defined by Sm — Yl^=i '^n- 

1 



2 



Definition 3.3. The series cin converges to £ if and only if the sequence of 

partial sums {sm} converges (as a sequence) to the number £. 

Logical Aside 

Before discussing tests for convergence of series, it is useful to recall the 
converse and contrapositive of a logical statement. We are interested in 
statements of the form: 

A: p ^ q. 

The converse statement is 

con{A) : q =^ p, 
and the contrapositive statement is "not q implies not p" : 

^q =^ -np. 

For example, if 

p = "you are in a running shower" 

and 

q = "you are wet" 

then p =^ q, "if you are in a running shower, then you are wet" is 
TRUE. The contrapositive statement "if you are dry, then you cannot be in 
a running shower" is also TRUE. If you think about it, this is always going 
to be the case: a statement and its contrapositive are either both TRUE or 
both FALSE. 

On the other hand, the converse of statement A is the statement "if 
you are wet, then you must be in a running shower" . This is clearly FALSE. 
As usual, we show that something is false by exhibiting a counterexample: 
you could be in a swimming pool. 

A convergent series will also be called summable for obvious reasons. In this 
section we want to develop tools for deciding whether or not a series is summable. 
The simplest of all tests is the following. 

Lemma 3.4. If the series X^^i '^n converges, then lim„_^oo On = 0. 

Discussion. Let Sm denote the mth partial sum of the series. Then, if J2'^=i '^n = 
we have that — >■ £ as m — >■ oo. But then 

limm^ooam = lim (s^ - Sm-i) = lim Sm - hm Sm-i = £ - £ = 0. 

m— >oo m— >-oo m— >oo 

Be warned: this result only works in one direction: we shall see in the next example 
that a„ ^ does not imply that the series is summable. □ 
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Example 3.5. The harmonic series ^ is not summable. This is proved 

by a simple grouping argument which shows that the sequence of partial sums is 
not bounded (and therefore is not convergent by the Useful Lemma of Section 2). 
Notice that | + | ^ | (sum of two terms each > |). Similarly, | + " " " + | ^ ^ 
(sum of 4 terms each > |)- Similarly, ^ + ' ' ' + ]^ ^ | (sum of 8 terms each > jq). 
That is, if we groups the terms into blocks of length 1, 1, 2, 4, 8, . . . we arrive at 
the following picture: 

1111 11 11 1 

" V ' " V ' " V ' " V ' 

— 2 — 2 — 2 — 2 

It follows that if?i = 1 + 1 + 2 + 4 + 8H [-2^, then s„ > |, so is not 

bounded, and therefore not convergent, so the series is not summable. 

Subtle aside. The above discussion may be pushed a little further: the harmonic 

series diverges, but just how fast or slowly does this happen? An approximate 
answer is the following: ifn = l + l + 2 + 4 + 8 + -- - + 2^=2^^+^, then Sn=k (the 
odd +1 or xi does not matter here). Put another way: for certain values of n, 
Sn is approximately log(n). We already knew that - and knew it very precisely - 
from Example 2.11. In that example, we showed that s„ differs from log(n) by an 
amount that is converging as n — >■ oo. 



Example 3.6. The geometric series r"' is summable if \r\ < 1 and is not 

summable if |r| > 1. This is clear: for |r| ^ 1 the mth partial sum is simply given 



What about series like Y^:^, or ^"'"o'^^a^^^ ? For series with non-negative 
terms, the next Lemma is very useful. 

Lemma 3.7. // all the terms an are non-negative, then the series Yl'^=i '^n con- 
verges if and only if the set of partial sums is bounded. 

Discussion. This follows from Theorem 1.6: if the terms are non-negative, then 
the sequence of partial sums is non-decreasing. (Series with some positive and 
some negative terms may fail to converge even if the sequence of partial sums is 
bounded: an example is Example 3.19 below). □ 



Theorem 3.8. [the comparison test] Suppose that < a„ < 6^ for all n. 

Then ifY^'^=i^n converges, so does Yl'^=\^n- 

Discussion. Let Sm = + • • • + and tm = hi -\- ■ ■ ■ -\- hm- Then for all m, 
< Sm < tm- Now {tm} is bouudcd, since Yl!^=i^n converges. It follows that 
{sm} is bounded, so c-n converges too. □ 
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Example 3.9. The series ^ 



oo 2+sin(n^+3) 
n=l 2"+n^ 



converges. This is easy: 



< 



2 + sin(n2 + 3) ^ 3 



and we know that J2'^=i ^ converges. 

A more sophisticated version of Theorem 3.8 is the following result: 

Theorem 3.10. [the limit comparison test] Suppose that an,bn > for all 
n, and lim„_^oo = c 7^ 0. Then X^^i converges if and only if X^^i 
converges. 

Discussion. Suppose &n converges. Since lim„_^oo = c, there is some 

N such that < 2c6„ for all n > N. But the sequence 2c ^^^^ 6^ certainly 
converges. So by Theorem 3.8, Y1'^=n converges, which implies that X^^i 
converges (Why?). 

The converse is immediate since lim^^oo tt = D 

Example 3.11. Prove that the series J2'^=i 2"+3-sm^(n3) converges. The solution 
is simple: let = 2^+3-sin'^{n^) ' ~ 2^' notice that |^ — )> 1. We know that 
converges, so by the Limit Comparison Test, so does X]a„. 

Example 3.12. Prove that the series Yl'^=i n'^i ^^^es not converge. Again, this 
follows from the Limit Comparison Test: the ratio ^ ) / (n) converges to 1, 
and we know that the harmonic series does not converge. 

Example 3.6 may be extended to give a new test that works for certain series that 
"look like" geometric series. 

Theorem 3.13. [the ratio test] Let > for all n, and suppose that 



Then if r < 1, Y^'^=i^n converges. On the other hand, if r > 1, then Y^^=i^n 
does not converge. 

Discussion. If r > 1 then the terms a„ do not even approach zero, so there is no 
chance of the series converging. 

If r < 1, then we may find a number s with r < s < 1. The hypothesis is 

that 



lim — 

n^oo a, 



= r. 



'n 



lim — 



= r 



SO we may find some N such that 




a, 
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We can write this out in a hst: 

Oiv+i < saN 



Cl'N+2 < SttN+l < s^aN 



a-N+k < S UN- 



Now we know that '^^Lo'^ns^ — '^Ar^feLi-s'^ converges since s < 1. So by the 
Comparison Test, 

oo oo 
n=N k=0 

also converges. This implies that CLn converges. □ 

Example 3.14. Show that X^^i converges. Apply the Ratio Test with a„ = 
^. The ratio is = — ^ — > 0, so the series converges. 

Despite all of the above tests, we have still not been able to decide whether or 
not X^^i converges. (Why does the ratio test not help?). In fact an 
annoyingly large number of series will turn out to have limiting ratio lim^_^oo 
equal to 1, which is exactly where The Ratio Test tells us nothing! In Example 

2.11 we have already seen a method to connect sums of sequence with areas under 
curves, and this is the key idea we need to develop the next convergence test. 

Recall that improper integrals are defined as follows: if / : M — )■ M is a 
function, we define the integral f{x)dx to be the limit of the sequence {a„} 
with terms defined hy gn = f{x)dx, provided this limit exists. If the sequence 
does not converge, then we say that the improper definite integral does not exist 
(or diverges). In symbols, 

nOO pN 

/ f{x)dx = lim / f{x)dx if the limit exists. 



Example 3.15. Let f{x) = where p > 0. Then f{x)dx exists if and only 
if p > 1. To see this, calculate the terms of the sequence, ajv = f{x)dx. We 
find that 

■p-i ^ p-i ; P ^ 



f{x)dx 



(p-l) NP- 

log N p — 1 



from which it is clear that {ajv} converges if and only if p > 1. 

On the other hand, definite integrals of the (proper) form f(x)dx may be 
interpreted as areas under curves, leading to the following simple but important 
result (which will be proved in another section of the course; for our purposes we 
will take it as being "obvious" . The only sense in which it is not obvious is that 
we have not really defined integration...). 
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Lemma 3.16. If m < f{x) < M for all x with a < x <b, then 

{b-a)m< [ f{x)dx<{b-a)M. 



Discussion. If we agree to think of definite integrals as areas, draw a picture to 
convince yourself that this result must be true. □ 

Let us agree to call a function / decreasing on [0, oo) if a; > y =^ f{x)< 
f{y) for all x and y in [0, oo). 



Theorem 3.17. Suppose that f is positive and decreasing on [l,oo), and that 

oo -AT 

f(n) = an for alln. Then a„ converges if and only if the limit lim / f(x)dx 

n=l "^1 

/oo 
f{x)dx) exists. 



Proof. Notice first that saying limiv->.oo ji f{^)dx exists is exactly the same as 
saying that the series 

/.2 ^3 j-A 

I f{x)dx + / f{x)dx + / f{x)dx + . . . 
J\ J2 Jz 

converges. Since / is decreasing (Check this by drawing a graph.), we have 

/(n + l)< f{x)dx<f{n). 

J n 

The first half of this inequality shows that the series 'Y^^=i 0"n+i may be com- 
pared to the series Y^^=i In~^^ f{^)dx, which shows that X^^i ctn+i (and hence 
X^^i On) converges if limjv-^-oo f{x)dx exists. 

The second half of the inequality shows that the series Xl^i !n^^ f{x)dx 
may be compared to the series On: proving that lim^v-^-oo f{.x)dx must 

converge if On converges. □ 

Example 3.18. The scries ^ converges if and only if p > 1. This follows 

at once from the integral test and Example 3.15 above. 

Example 3.18 gives us another proof that the harmonic series 'Y^^=i n 
verges - this is in fact the third proof we have. (Where is the third proof?) It 
also, finally, tells us that ^ converges. In the second year complex analysis 

course, you will find that this sum may be evaluated exactly: X^^i ^ = 

Remark. The series we have considered have all terms of the same sign. Series 
in which terms can be both positive and negative are slippery customers. There is 
one simple general result, Leibnitz's Test, which is given below as Theorem 3.20, 
that shows the alternating harmonic series 1 — h + h — j + converges. 
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Theorem 3.19. [liebnitz's test] Let X^^i On be a series whose terms are 
alternately positive and negative. Suppose that the terms decrease in size (i.e. 
I On I > |o^n+i| for all n) and converge to zero in size (i.e. a„ — >■ as n — >■ ooj. 
Then the series Y^'^=i is convergent. 

Discussion. The theorem is proved by the following argument. Let Sn = ai + 
\- an denote the nth partial sum of the series. First it is shown that 

S2 < S4 < Se < . . . 

and 

Sl > S3 > S5 > • • • 

and finally 

Sk < Si 

whenever k is even and I is odd. 

It follows that {s2n} is a non-decreasing sequence, bounded above by si, 
hence convergent. Let a — lim„^.oo S2n- 

Similarly, {s2n+i} is a non-increasing sequence, bounded below by S2, hence 
convergent. Let ^ = lim^^oo 5271+1 • 

We are nearly done: since S2n+i ~ S2n = 0-2x1+1 0, we have that a = j3, so 
the series is convergent. (Why does a = ^ prove the series is convergent?). 
□ 

Example 3.20. Let a„ = — • Then Yll^=i On — ^ — \-\-\ — ■■■ converges by 
Leibnitz's test. As in other cases, more advanced methods from complex analysis 
allow the sum to be evaluated exactly: YliOn = log 2. 



Things you should have learned in this section 

(1) The definition of convergence for series. 

(2) Definition of convergence in terms of the sequence of partial sums, and 
consequences. 

(3) Examples of series: harmonic, geometric, power series. 

(4) Tests for convergence: comparison, limit comparison, ratio, and integral 
tests. 
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